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(57) ABSTRACT 

The present invention is a method and system of analyzing 
a stimulus using a computer network such as the Internet. 
The invention can be used to niore effectively analyze any 
stimulus that may be presented via a personal computer 
connected to the network by asking a participant attitudinal 
and/or behavioral questions regarding a stimulus while 
monitoring the participant* s behavior when interacting with 
the stimulus, and more specifically monitoring which por- 
tions of the stimulus the respondent views and for how long, 
asking a set of attitudinal and/or behavioral questions 
regarding the participant's reaction to the stimulus, statisti- 
cally analyzing the data collected to determine an effective- 
ness coefficient to the stimulus as an indication of its 
effectiveness. 
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1. Have you ever visited any of the following websites? 

Yes No 

Website 1 
Website 2 

Websites . . 

2. How often have you visited each of the following websites? 

Daily 4-6 2-3 times Weekly Twice a Once a Less than Never 
times/ /wk month month once a 

wk month 
Website! _______ 

Website2 
Website3 

3. How did you initially locate these websites? 

Word of Surfing Banners/ Other Search Other Never 
Mouth the Web Advertising Advertising Engine/ Located 

Directory 

Website 1 
Website2 
Websites 



FIG. 5A 
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1 . From which of these websites would you most likely purchase products and/or services? 

WelBite 1 
Wel)sile2 
Website 3 

2. Which of these websites would you mostlikely re-visit? 

Website 1 
Website 2 
Website 3 

3. Which of these websites ofler products/services that are most affordable? 

Website 1 
Website 2 
Websites 

4. Which of these websites offer products/services that provide a good value? 

Website 1 
Website 2 
Websites 
None 

5. Which of these websites offer products/services which are most effective in achieving [a 
stated goal, e.g. "weight bss' for a diet-related website]? 

Website 1 
Website 2 
Websites 

6. Which of these websites would be most effective In helping you adopt a healthy lifestyle? 

Website 1 
Website 2 
Websites 



Please rate how likely you would be to purchase a product/service from each of these 
websites: 



Website 1 
Website 2 
Websites 



Definitely Will 
Purchase 



Probably Will 
Purchase 



May/May Not 
Purchase 



Probably Will 
Not Purchase 



DefintelyWill 
Not Purchase 



FIG. 5B 
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Please read the following statements regarding the xyzcorp.com website's interactivity and then tell us 
whether you agree strongly, agree somewhat, neither agree or disagree, disagree somewhat, or disagree 
strongly with each statement. 

The xyzcorp.com website... 




Agree 
Strongly 


Agree 
Somewhat 


Neither Agree 
nor Disagree 


Disagree 
Somewhat 


Disagree 
Strongly 


...has enough links/connections 
to related websites. 


- 


- 


_ 


- 


- 


...has enough links/connections 
to other things you want to see 
and/or use. 












...allows you to be interactive 
when you want to be. 












...has website components that 
work the way they are supposed 
to. 












...has pages that were too slow 
when downloading. 












...can be counted on to work 
properly at all times. 












...has a response speed that 
meets my needs. 












...is a website 1 would use 
frequently. 












...has individual pages that were 
poorly designed. 












Continue 



FIG. 5C 
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2. 



3. 



4. 



Which of the following describes your age? 

Under 21 
21-49 

50 and over 

Which of the following describes your current wori( status? 

Fult-time 
Part-time 
Student 

Other I 

Which of the following describes your education? 

Some high school or less 
Completed high school 
Some college 
College-Associates Degree 
College-Bachelors Degree 
Some Graduate School 
Completed Graduate School 

Which of the following best describes your current household income? 

Under $25,000 
$25.000-$39,999 
$40,000-$59,999 



$100,0004149,999 
$150,000+ 

Are you Male or Female? 
I^ale 

Female _ 




FIG. 5D 
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1 . Which of the following websites do you remember visiting yesterday? 

Website 1 
Yahoo.com 

Website 2 I 
Amazon.com 
Websites . 
EBay.com 

2. Which of the following websites would you purchase products/services from? 

Website 1 

Website 2 I 

i3 : 



3. Which of these websites would you re-visit? 



Website 2 
WebateS 

4. Which of the following websites do you think needs significant improvement? 



sitel 
Website 2 
Websites 



Content Graphics Linkage Interaction Speed Other None 

Website! 
Website 2 
Websites 



6. Which of the following websites do you prefer? 



Website 1 
Website 2 
Websites 



FIG. 5E 
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Hello, I'm from e-ValuW^.cx)m, a website evaluation fimi. You recently partidpaled 

in an Internet survey dealing with . You said that you would be wiDing 

to help us by answering a few follow-up questions. We will pay you $ for your help. 

1 . You viewed three websites: Website 1 , Website 2, and Website 3. Which of these websites 
did you like best? 

Website 1 
Website 2 
Websites 

2. Why do you say that? What was there about that made you prefer this website 

over ttie others? 

Any other reasons? 

We would like to ask some follow-up questions about one of these websites, Website 2. [the website 
being evaluated] 

1. What did you like best about Website 2? What other good features did it have? In what ways 
was it better than the other websites? 

2. What did you dislike most ^ut Website 2? What other features did you dislike? In what 
ways was ttiis site not as good as the other websites? 

3. How couW Website 2 be improved or made better? What other changes could be made? 
(Alternative question: IF you could give the people who designed Weosite 2 some advice, 
what would you tefl them? What other advice would you give?) 

3A. How could they improve what was said? 

SB. How could they improve how it looks? 

SC. How could they make it easier to use? 

3D. Of ttie changes you suggested, whkii one or ones are most important? 

4. What else wouki you say to the people who designed Website 2 that would help them do an 
even betterjob of designing the websites? 

5. ■ When you first viewed Website 2, what was your first reaction? What went through your 

mind? What other thoughts and feelings did you have? 



FIG. 5F 
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e-ValueWeb 

Leaders in Web Site Eyalustion 



You are taking a survey. 

The operation you are trying to do is not allowed. 

Please hit the back button in your browser to confinue the survey 



FIG. 7 
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Respondent No: 0237 
Total Time: 0:01:00.0 





TOP-LEFT 
PIXEL 


WINDOW 
SIZE 


TIME 


http;//wwwjesearchsite.corn/index.htn[i 


0000,0000 


700,550 


0:00:15.0 


ht(p://www.researchsite.com/index.htm 


0020,0000 


700,550 


0:00:00.5 


http://www.f6seaFchsite.corn/index.htrT] 


0035,0000 


700,550 


0:00:00.6 


htlp://www.researchsite.com/index.hlm 


0056,0000 


700.550 


0:00:12.5 


http://viiww.resear(;hsite.coni/index.htni 


0079,0000 


700.550 


0:00:00.4 


http://www.researchsite.com/inclex.htm 


0098,0000 


700.550 


0:00:00.6 


http:/iWww.researchslte.com/inclex.htm 


0132,0000 


700,550 


0:00:00.4 


http://www.researchslte.com/index.htm 


0135,0000 


700,550 


0:00:05.5 


http:y/www.researchsite.com/topic1 .htm 


0000,0000 


700,550 


0:00:08.0 


http://www.researchsite,com/topic1 .htm 


0077,0000 


700,550 


0:00:00.5 


http7/www.researchsite.com/topic1 .htm 


0158,0000 


700,550 


0:00:03.5 


htlp://www.researchsite.com/moreinfo.htm 


0000,0000 


700,550 


0:00:06.0 


http'y/www.researchsite.com/moreinfo.htm 


0020,0000 


700,550 


0:00:00.5 


http://www.researchsite.com/moreinfo.htm 


0037.0000 


700,550 


0:00:00.5 


http'y/www.researchsite.com/moreinfo.htm 


0059,0000 


700.550 


0:00:00.5 


httpi/www.researchsite.com/moreinfo.htm 


0082,0000 


700,550 


0:00:05.0 



FIG. 8 



02/18/2004, EAST Version: 1.4.1 



U.S. Patent May 7, 2002 sheet 14 of 14 US 6,385,590 Bl 



From: 

To: 

Subject: 
Date: 



e-ValueWeb.oom 

Potential Respondent <nanie@email.coni> 
COLLECT $20.00 FOR YOUR OPINIONS 
Thu. 19 Oct 2000, 07:08:46-0500 



e-ValuWeb.coni 

e-ValuWeb.com is currently conducting an on-line research study and would lilce to GET YOUR 
OPINIONS. Tliere are absolutely NO SALES INVOLVED! The results will be used FOR 
RESEARCH PURPOSES ONLY 

The 15-20 minute study is about (insert subject here) and includes your personal analysis of three 
(subjectj-relaled Web Sites. The FIRST FIFTY (50) people to FINISH the survey will receive a 
CHECK FOR $20.00. 

If you are interested, please go to http://www.e-\^uWeb.com. Please use the following login 
and password: 



After you have completed the survey, please make sure to i out the NAME AND ADDRESS 
section COMPLETELY so we can mail you your CHECK FOR $20.00, if you qualify. Please 
allow 7 to 10 days for receipt of your payment. 

Thank you for joining us, 

e-ValuWeb.com 

If you have any comments or questions, please contact us at service@e-ValuWeb.com. Your 
inquiries will be handled by a REAL PERSON. If you wish to be excluded or removed from 
^ture mailings please reply to this email and type the word REMOVE in the subject area. 



Login: 
Password: 



A100 
t1017 



FIG. 9 
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METHOD AND SYSTEM FOR because these systems would contaminate the rest of the 

DETERMINING THE EFFECTIVENESS OF A researcher's data. 

STIMULUS With the advent of computers, researchers began execut- 
ing research by programming computers to ask the respon- 

STATEMENT OF COPYRIGHT 5 (jgnts a variety of research questions, including attitudinal, 

A portion of the disclosure of this patent document usage, and classification questions. Computers made 

contains material which is subject to copyright protection. research interviewing more efiBcient and more effective. The 

The copyright owner has no objection to the facsimile computer programs written would automatically record the 

reproduction by anyone of the patent document or the patent respondents' responses for analysis at a later time. While 

disclosure, as it appears in the Patent and Trademark Office 10 an improvement, large amounts of resources were 

patent file or records, but otherwise reserves all copyright ^^^^^ required. That is, candidates still were required to travel 

rights whatsoever. " *to the research location, physical space must still be pro- 

1. Field of the Invention vided for the research to occur, computers must be supplied 

TT, » . ^. t ♦ * 1 *■ r 1* for the candidates* use, and there must still be a laree pool 

The present mvention relates to evaluation of stmiuli. r , -1. / . 1 • .1. 1 , 5^. . 

* ' tu ^ ^ ♦ f 15 of candidates wilhng to partake m the research. In addition, 

More specifically, the invention is a method and system for u . 1.1 . u 

determining the effectiveness of stimuU using the Internet ^ ^searchers were stUl not able to compare how a respon- 

for evaluatLg stimuli and their effect on respondents. "'f ^''"u ^ """^ 

2 Back round of the Inventio above examples, candidates are often drawn from 

^ the student body of a university, or advertisements are 

Various methods for determining the effectiveness of a 20 dispersed in search of respondent candidates in a local 

stimulus, such as an advertisement or a pictorial display, are geographic area. Both of these techniques Umit the respon- 

well known in the art. For instance, researchers often dent pool to either a predetermined group of individuals or 

conduct non-computerized studies on the effectiveness of a individuals located within a limited geographic area, 

stimulus, usually m an academic, non-profit, government, ^ith the advent of the Internet, researchers became able 

commercial environment, or the hke A researcher will 25 ,^ responses from respondents in a 

assemble a pool of respondents who they wiU then ask to non-personally interactive way. Researchers, and profes- 

view a stimulus. For this example, assume the stimulus is a ^j^^^j ^^^^^^^^ companies, began developing websites 

pnnt advertisement. Each respondent, m isolation except for ^^ ^^^^ ^^^^^ undertaken. ITiat is. respon- 

optionally the researcher, will view the stimulus. The ^^^^ ii,^ ^^^site, view the stimulus on the website, and 

researcher wiU then ask each respondent what he or she 30 respond to questions regarding the stimulus on the website, 

liked, dishked. etc. regardmg the stimulus. These questions ^ ^ ^j^^^.^ ^ ^^^site is www.greenfield.com. There 

are generaUy referred to as attitudinal questions. They will ,1,^ development of specialized software that 

often contmue by asking the respondent whether he/she is tracked a respondent's navigation throughout a website by 

more or less likely to purchase the goods or use the serv.as recording the hyperlinks on which a respondent cUcked and 

advertised as a result of v.ewmg ancVor interacting with the 35 ^ ^^^j ^^^^^ respondent cUcked on each of them. Also 

stunulus. These questions are generaUy referred to as behav- ^^^.^^j^j ^ jhe amount of time between hyperUnk cUcks. In 

loral questions Other attitudinal and behavioral measures (his manner, researchers and proprietors of websites can 

mclude what characteristics of the goods and services are determine which pages of a website are viewed most often 

important/ummportant, the potential purchase frequency of j ^^^^ ^^^^^ However, the present 

the goods or services and the relative preference versus « methods of tracking do not aUow a researcher to determine 

competing goods or services. At some point m the research ^^^^^ -^^ „f ^ ^j^^^j ^^^^ ^^^^ 

process the researcher will ask the respondent classification ^ jer than the browser window's height or width, 

questions to deteraime m which demographic the respondent J^,^^ researchers cannot measure what the respondents are 

belongs. Classificauon questions mclude questions relating specifically looking at within a web page, 

to age, gender, income, mantal status, parental status, lob d<: i • -i f u- u i u j i j *i- * 

t e and the like ' In similar fashion, software has also been developed that 

^r' / , , , . monitors when a respondent clicks on a banner advertise- 

Non-computerized research is extremely time consuming ^^^^ ^ ^^^^^^^^^ ^^^-j^^^ subsequent transac- 

and requires extensive resources such as research personnel, ^^^^ ^^^h the advertised company. That is, it is recorded 

physical space to conduct the research, respondent pools, ^^^^^^^ j^e respondent purchased goods from the advertised 

and requires that the respondents physically travel to the 50 company or not. However, in using these types of systems, 

research location. Also this method of research does not ^^^^^ researchers are able to draw from a larger respondent 

allow a researcher to unde^tand the mteraction of a respon- ^^j^ ^^e research is still limited in that the respondents are 

dent with a stimulus and the stunulus relationship to their ^^^^-^ ^ environment where there is no understanding 

attitudinal, usage, and classification responses. ^^^^^j ^^^^^^^ ^-^^-^^ relationship of stimulus 

Researchers in this manner evaluate many different types 55 viewing on attitudinal, usage, and classification measure- 

of stimulus, including print advertisements, television ments. In the above examples, it is not possible to accurately 

advertisements, radio advertisements, photopictorial compare how a respondent answers research questions with 

displays, physical designs of consumer goods, movie how the respondent behaves while interacting with a stimu- 
trailers, television programs, editorial contents, book 

jackets, clothing designs, automobile designs, and the like. 60 

However, researchers could not evaluate these stimuli based SUMMARY OF THE INVENTION 

on the precise portion of the stimulus at which the respon- The present invention is a method and system of evalu- 

dents were looking. Later developed were systems to track ating a stimulus and the effect of the stimulus on a respon- 

eye movement that attempted to measure which portion of a dent using a computer network such as the Internet. The 

stimulus was being viewed. However, there was a bias 65 invention can be used to more effectively evaluate any 

inherent in these systems that detracted from their accuracy stimulus that may be presented via a personal computer 

to such a degree that researchers often would not use them connected to a network. 
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The iavention asks a respondent attitudinal and/or behav- computer network such as the Internet. The invention can be 

ioral questions, then monitors a respondent's behavior while used with respect to any stimulus that may be presented via 

viewing a stimulus. In one embodiment, the stimulus is a personal computer connected to the network. Types of 

stored on the research taker's server. The stimulus can be stimuli that may be analyzed include visual stimuli such as 

*any type of stimulus that can be stored on and presented 5 photographs, print advertisements and banner advertise- 

using conventional personal computers. The system moni- ments for websites, audio stimuli such as radio 

tors the respondent's behavior through use of a computer advertisements, jingles, and sound efiFects, and multimedia 

program associated with a web page used to display the ^^'^^^^ ^^^^ Internet websites, application software, 

stimulus. games, television advertisements, movie trailers, and the 

, ^. . . . . , . ;n like. The invention may be used to aid in making marketing 

In another embodiment of the mvention, the stimulus is a 10 ^^^^j^^g^ advertising decisions, political decisions, and the 

website stored on an mdependent website host's server. The i^^^ stimulus that is capable of being presented over a 

research server acts as a proxy server, filtering the web page computer network may be analyzed such that a researcher 

information on the fly by rebuilding hyperlinks, canceling ^an understand a respondent's reaction to the stimulus and 

'post' operations, and associating program code with the relate the reaction to attitudinal, behavioral, and classifica- 

filtered web page to enable the system to monitor the is ^.^^ measures 

respondent's behavior The system monitots and records the T^e invention provides a method and system for more 

hyperlmks on which the respondent chcks, the amount of ,^„ra,eiy measuring the effectiveness of a stimulus, as well 

time between hyperlmk clicks and the portion of the web ^^^^^ ^ ^^^^^^^ ^^^^^ ^ respondent, using a 

page the respondent is specifically looking at by recording in ^^^^j ^^j, ^ 

one-half second intervals the coordmate of the pixel in the 20 , v ■, 1- ... 

, r • ui r L -J The invention will now be described with reference to the 

top left comer of the viewable area of the browser wmdow ^ 1 j- 1 * * j • ^1 

^. . r • *_i r u -J figures. FIG. 1 displays computers connected via a network 

and the size of the viewable area of the browser window. r ■ j j . a u 

for the inventive method and system. A research server 100, 

In one embodiment, the system invites a respondent to j^ast one client computer 102, and optional external 

participate in the research study, presents usage questions to website servers 104 are connected via a global computer 

the respondent, stores answers to the usage questions in the information network, such as the Internet. For purposes of 

computer memory, presents a first stimulus to the this specification, when a respondent downloads .html, .xml, 

respondent, measures the stimulus reception and processing ^sp or like pages from a website server 104, the respondent 

data, optionally presents one or more additional stimuli, ^^id to 'visit' the website by viewing the information 

measuring reception and processing data for each one, downloaded from the website server to the respondent's 

presents a first set of attitudmal questions to the respondent, computer 102 using an Internet browser such as Microsoft® 

stores answers to the first set of attitudinal questions in the Internet Explorer®, Netscape® Navigator®, or the like, 

memory of the computer, re-presents at least one stimulus to embodiment, the stimuli to be analyzed are stored 

the respondent, measures stimulus perception and proce^- ^^^^^^ ^^^^^ purposes of example only, in 

ingdata,presentsasecondsetof attitudinal questions to the embodiment, the stimuli are photographs stored in a 

respondent, stores answers to the second set of attitudinal ^^^^^ graphical format, such as jpg, .gif, or .tiff. The 

questions in the computer memory, presents third set of ^^^^^^^ ^^^^^^ ^^^^^^^^ I^t^^^t ^^^^^^^ ^^^^^^ 

attitudmal questions to the respondent to measure delayed providers, not used in this embodiment. The research server 

impact, store answers to the third set of attitudmal questions ^ computer adapted as a web server and contains a 

m the computer memory, optionally performs a telephone 2OO. The memory 200 contains website data 202, 

interview with the respondent, stores answers from the ^^-^^ j^^j^^^^ ^^^^^ P^l^^^ ^^^^ ^ html, .asp 

telephone interview in the computer memory, collects and ^j^^ ^^^^ ^^^^ ^^^^^^ ^^^^^^ information 

mtegrates the results database, analyzes the database, pro- regarding the research study to respondents participating in 

vides a score as an indication of at least one stimulus from ^^^^ ^^^^^^ the web server program 

the research study, and provides substantive feedback to the ^04, optional stimulus data 206, the research data 208, 

stimulus owner. application programs 210, and research results 212. The 

BRIEF DESCRIPTION OF THE DRAWINGS ^|^°^^}!^ ^^^^.^i!^ may include graphic^ files to store visual 

stimuli, sound files to store audio stimuli, or multimedia files 

FIG. 1 depicts computers connected via a network for use to store multimedia stimuli. The resuUs data 212 is stored on 

in the present invention. 50 the server 100 as a result of respondents' participation in the 

FIG, 2- is a computer adapted to perform the present research study, as indicated below. In this example the 

invention. stimulus data 206 is the photographs in graphical file format. 

nC. 3 is a flowchart of one embodiment of the invention, ^h^ ^^^^^^^^ ^^^^"""^ """"^ "^'^^ '^^^ u 

ence to FIGS. 2-3. In step 300, a respondent visits a research 

55 website start page stored in memory 200 of the research 
server. The web page gives the respondent basic information 

FIGS. 5A-5F are questions used in the invention, regarding the background of the research project such as 

FIG. 6 is a sample stimulus website. what the respondent will be viewing, what is expected of the 

FIG, 7 is a sample error page. respondent, how much time the research should take, and 

fig' 8 is sample output produced through the inventive other relevant information to the respondent. The 

system and method respondent, via the website on the same or a different web 

' . . . page, is optionally asked usage questions regarding the 

HG. 9 IS a sample invitational email. respondent's predisposition to the subject matter of the study 

DETAILED DESCRIFnON tf^^. ^u^' ''^ '^"'^"^ '° '"'"'^'^ 

65 208 or the research server. 

l^e present invention is a method and system of analyz- In step 304 the respondent receives the stimulus 206 via 

ing a stimulus and its effect on a respondent using a the same or another web page stored on the research server 



FIG. 4 is a flowchart of a second embodiment of the 
invention. 
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100. By receiving the stimulus, it is meant that the respon- research server. Two common variables available in web 

dent views the visual stimulus, listens to the audio stimulus, browsers include the coordinate of the pixel in the top left 

or both in the case of a multimedia stimulus. In this example, comer of the browser window, and the current pixel size of 

the respondent views the photographs stored in graphical file the browser window. The system records these two variables 

format as a web page using an Internet browser program. 5 every one-half second to determine which specific portions 

After the respondent is finished watching and/or listening to of the web page the respondent is viewing and for how long, 

the stimulus, the respondent proceeds to answer a set of In this manner, the system can monitor exactly what the 

attitudinal questions regarding the stimulus, or the goods or respondent is looking at when the web page consumes more 

services advertised by the stimulus, in step 306. The attitu- than one window length or width in size. Also, in the photo 

dinal questions are stored in a portion 208 of the memory example above, where the photo cannot be fully displayed in 

2^^* one viewable portion of a browser window, this method and 

Steps 300-306 are repeated multiple times by a plurality system can determine which portions of the photograph 
of respondents to gather additional data regarding the stimu- research participants viewed most, and for how long, 
lus. Generally about one hundred to five hundred respon- When the respondent clicks on a hyperlink in order to 
dents participate in each research study. However, it is ^5 view another web page, the system retrieves the requested 
possible that more respondents or fewer respondents could page from the independent website server, transforms it as 
participate, depending on the research study. After a useful described above, and serves it to the respondent for brows- 
amount of data has been collected, the data is statistically ing. The system also records the hyperlink the respondent 
processed in step 308. Based on the statistical analysis, as clicked on to request the page and the time interval since the 
well as other factors, a score is assigned to the stimulus 20 previous page request. In this manner the system can moni- 
regarding its effectiveness in step 310. tor which pages the respondent views and for how long the 

In another embodiment of the invention the stimulus respondent views them. If the respondent clicks on a hyper- 
being evaluated is an Internet website hosted by one of the link that initiates a 'post* operation, the system informs the 
website servers 104. The method of the present embodiment respondent that the 'post' operation is currently disabled, 
is described with reference to FIG. 4. In step 400 a potential 2s and allows the respondent to continue browsing other 
respondent is recruited by sending an invitational email, aspects of the website, as shown in FIG. 7. 
including information necessary for the respondent to par- While the respondent is visiting the website, the system 
ticipate in the research study. The email, such as one shown monitors the respondent's movement throughout the website 
in FIG. 9, includes information such as a login code and in step 420 as described above and stores the collected data 
password, the URL of the website to at which the respondent 30 in a data file 212 on the research server 100. When the 
participates in the study, and informative material regarding respondent is finished visiting the website, the respondent 
the research. The respondent then visits the URL on the informs the research server that s/he is finished visiting the 
research server 100, and logs into the research server using website by clicking the overlaid 'Done' button in the comer 
the supplied login code and password. of the current web page. This causes the system to close the 

In step 405 the respondent is presented with information 35 browser window containing the independent website pres- 

regarding the study and is presented with usage questions ently being viewed by the candidate. Steps 415-420 may be 

such as those in FIG. 5A. Usage questions, generally, are. repeatedany number of times so that the respondent can visit 

questions relating to a respondent's previous experience and the system can collect data regarding multiple websites, 

using and/or interacting with the stimulus/stimuh being This allows the system to compare data from one website 

evaluated. After answering the usage questions, the system 40 against data from another website. 

stores the results 212 in the server memory 200 in step 410. FIG. 8 shows sample data gathered while a respondent is 

The respondent is then prompted to visit a first independent viewing a website. FIG. 8 shows the URL visited with the 

website 104fl in step 415. specific viewable portion and the duration. FIG. 8 shows that 

Upon determining that the respondent is ready to begin the respondent viewed the website for a total of one minute, 

visiting the independent website, the system retrieves the 45 The respondent initially viewed the default portion of the 

independent website information from website server 104fl. website's home page for fifteen seconds. This is shown by 

The server 100 acts as a proxy server to the respondent the pixel in the lop left comer of the display window 

viewing the website, transforming the independent website (0000,0000) being the pixel in the top-left comer of the web 

information on the fly into research compatible format. page. The default portion of a web page is the portion first 

Research compatible format is achieved by first amending 50 displayed in a web browser when a web page is loaded. The 

all hyperlinks to be redirected through the research server as respondent's window display size is 700 pixels by 550 

a proxy server. The system also removes any 'post' opera- pixels. Using this data, a researcher knows that the respon- 

tions in the .html code. Finally, the system transforms the dent initially viewed the top 550 pixels and the left-most 700 

web page into a framed page, wherein the original page pixels for fifteen seconds. FIG. 8 further shows that the user 

consumes all but one pixel width and/or height of the 55 slowly scrolled down until the top-left pixel in the display 

browser window, and the system inserts a 'Done' button window was pixel 0056,0000, where the respondent paused 

overlaying the page in a comer of the window. FIG. 6 depicts for 12.5 seconds. The researcher knows that the respondent 

a stimulus website with the 'Done' button in the lower right viewed the leftmost 700 pixels in the vertical range 0056 to 

corner of the browser window's viewable area. In one 0606 for 12.5 seconds. The respondent then continued 

embodiment, this button remains in the comer regardless of 60 scrolling down, slopping when the top-left pixel was 0135, 

whether the respondent scrolls up or down or left or right on 0000. After reading or viewing that portion of the web page 

the web page. With the one pixel height portion of the frame for 5.5 seconds, the respondent clicked on a hyperlink to the 

is associated program code written in JavaScript, or other URL http://www.researchsite.com/topicl.htm, where the 

suitable programming language, that monitors the respon- user viewed the default portion of that web page for 8 

dent while viewing the web page. The JavaScript code 65 seconds before scrolling down. After scrolling down, the 

monitors the respondent by recording specified variables in user viewed a portion of the web page for 3.5 seconds before 

one-half second intervals and sending the results to the clicking on a hyperlink to the URL http:// 
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www.researchsile. com/mo reinfo.htm. Similar detail is various website stimuli can be compared to determine 

shown for the respondent's viewing of the web page http:// strengths and weaknesses of each stimulus. Generally 

www.researchsite.com/moreinfo.htm. between 100 and 500 respondents participate in a research 

Using the information in FIG. 8, a researcher can deter- ^^^y* However, it is possible to use a lesser or greater 
mine an amount of time each respondent viewed each web 5 amount of participants, depending on the level of accuracy 

page, each portion of the web page, and a total time spent constramts, manpower constraints, etc. It is 

viewing the entire web site. The researcher also knows the P°"^*^^ ^^^^ ^^^nnTm ' respondents is greater than 

f i_ u . • J J r 10,000, or even 100,000. 

specinc portions oi each web page that were viewed and for a /• n ... ^ 

how long, as well as the specific path that the respondent . all participants have finished visiUng the websites in 
followed while visiting the website. The data in FIG. 8 is lO Ihe research study, the system imegra^ 

«r^c-„t^^ • f Ai f . ^ u a Single database in step 470. The system analyzes the data 

presented in a user-friendly format. The research server ^ 475 ^^^^/^^ ^^^^^^^ ^^^^^^.^^^ 

receives data m one-half second intervals includmg the ^^^y^^^ ^^e collected responses from the plurality of 
URL, the top-left pixel, and the window display size. The respondents and the monitoring data collected on the 
total time per portion of the web page is then calculated research server. The data is then combined and correlated, 
based on the number of consecutive one-half second reports ^5 combined data correlation is important in that the 
received with respect to the same portion of a web page. effectiveness of a web site is better represented and under- 
After the respondent informs the research server that the stood by a unique weighted combination of measurements 
respondent is done, and there being no more remaining that reflect those portions of the web site that respondents 
websites for the respondent to visit, the research server have viewed and for how long, correlated with the responses 
prompts the respondent via a web page to answer a first set pertinent attitude and usage questions. It is the optimal 
of attitudinal questions stored in a portion 208 of memory combination of survey question responses and web site 
200 regarding the visited website in step 425. A set of momtonng that leads to the calculation of an effectiveness 
attitudinal questions is shown in FIG. 5B, The answers to the coefficient m step 480. In step 480, the system assigns a 
first set of attitudinal questions are stored in a portion 212 of website, based on the analysis m step 475, as an 

th» ™« 2 inn •„ /iin 25 indication of the website's effectiveness as a stimulus. The 

the computer memory 200 m step 430. effectiveness coeflicient is derived from known methods of 
Upon completion of the first set of attitudinal questions, statistical analysis performed on the data received from the 
the respondent is again presented with at least one website respondents' surveys in combination with the data collected 
stimulus in step 435. That is, the respondent is again asked while monitoring each respondent's interaction with each 
to visit at least one website. In step 440, the system again stimulus. Based on the analyzed results and the effectiveness 
monitors and records the respondent's movement and usage coefficient assigned to the website, the researcher provides 
of the website as described above. The respondent again substantive recommendations to the stimulus owner regard- 
clicks on an overlaid ^ done' button to indicate to the system ing the stimulus' strengths and weaknesses, as well as 
that the respondent has finished visiting the stimulus web- regarding the effect the stimulus produced in the respon- 
site. Next, in step 445, the respondent is presented with a dents. 

second set of attitudinal questions regarding at least the while the method of the invention has been described 

stimulus most recently visited. A second set of attitudinal ^th respect to a preferred embodiment, it is possible that 

questions is shown m FIG. 5C. The answers to the second set ^^^^^ ^^e above-described method may be rearranged and 

of attitudmal questions are stored in a portion 212 of the ^till engage the spirit of the invention. For instance, the 

memory 200 in step 450. Finally, the respondent is presented telephone interview could be conducted before the respon- 

with a set of classification questions mstep 452. A set of dent is presented with the delayed third set of attitudinal 

classification questions is shown in FIG. 5D. The system questions, or the classification questions could be presented 

stores the answers to the classifications in a portion 212 of early in the method, rather than near the end of the method, 

the memory 200 in step 453. ^sing the invention as described above, a researcher can 

In another embodiment of the invention, at least one 45 relate respondents' visits to websites or other stimuli with 
respondent is presented with a third set of attitudinal ques- attitudinal measures to predict future behavior. The inven- 
tions to test for the delayed impact ofthe stimuli. That is, the tion allows a researcher to compare how a respondent 
respondent is asked to return to the research website at a responds to research questions with how the respondent 
later time, generally the next day, and is presented with a actually behaved in the research study by tracking informa- 
third set of attitudinal questions, in step 455, regarding the 53 tion such as which portions of the stimulus the respondent 
stimuli presented during the research study. A delayed specifically looks at and for how long. The respondent 
impact third set of attitudinal questions is shown in FIG. 5E. cannot respond in one manner to the attitudinal questions 
The delayed impact research may be accomplished by and behave in another manner while viewing the stimulus 
sending the respondent an email with a an embedded hyper- without the researcher being aware that the respondent is 
link on which the respondent can click to visit a web page 55 doing so. The present invention is a more accurate method 
on the research server that contains a third set of attitudinal and system for evaluating stimulus, 
questions. The answers to the delayed impact attitudinal In one embodiment, the invention described herein can be 
questions are stored m a portion 212 of the memory 200 of ^sed to evaluate a website as compared to the website's 
the research server in step 460. competitors. The invention would use multiple websites as 

In another embodiment of the invention, at least one 60 stimuli, monitoring a respondent's interaction with each one. 

respondent is interviewed, via telephone or other form of it is apparent in this regard that the invention can be used to 

audio communication, in step 465. Answers from the tele- analyze a website against competitor's websites to deter- 

phone interview are stored in a portion 212 of the memory mine its strengths and weaknesses as well as market appeal 

200 in step 467. A set of telephone interview questions is to consumers. It should also be apparent that the invention 
shown in FIG. 5F. 55 can be used to determined the effect of a stimulus on one or 

Steps 400-465 are then repeated for a plurality of respon- more respondents, as well as to compare the effect of two or 

dents such that enough data is gathered so that data from the more stimuli on a group of respondents. 
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It is also possible, using the inventive niethod and system 
as described above, to evaluate the efifect of a stimulus on a 
respondent or a group of respondents. In one embodiment 
the invention is used to evaluate respondents reactions to 
hair color. The invention is performed with respect to FIG. 5 
4, as described above. The stimuli presented in steps 415, 
435 are two or more websites that differ only with respect to 
a single, or limited amount, of photographs. The text and 
other content of the websites are substantially identical. In 
the first website, shown in FIG. 6, the photograph depicts a 
person with dark black hair. In a second website, everything "^^ 
else remaining substantially identical, the photograph 
depicts a person with light hair. By measuring the respon- 
dents* interaction with the two websites using the method 
and system described above, a researcher can determine 
whether the respondents prefer dark hair to light hair or vice 
versa. By including additional websites with photographs 
depicting persons of other hair colors, such as red, different 
information is obtained. 

In another embodiment of the invention, political stimuli 
are presented to the respondents. That is, the stimuli are two 20 
or more political websites that are evaluated against each 
other, and the respondents recruited for participation are 
undecided voters. By way of example, if the researcher 
wants to determine which political message is more appeal- 
ing to a group of undecided voters, the researcher can 25 
prepare the two websites to be substantially identical with 
the exception of one instance of a candidate's political 
position on an issue. If more instances are varied from one 
website' to the other the results are less accurate. The 
invention then is performed as descri|;)ed above with refer- 
ence to FIG. 4. By monitoring which portions of the website 
the respondents viewed and for how long, it can be deter- 
mined which of the candidate's political positions on an 
issue is more appealing to undecided voters. 

While the invention has been described in specific 
embodiments, it should be apparent to one skilled in the art 
that programming languages other than JavaScript and dif- 
ferent browser software may be applied to achieve the same 
results. 

It should be appreciated by those skilled in the art that 
modifications may be made, or various methods or systems 
may be used, which are within the scope and spirit of the 
present invention as defined in the appended claims. 

What is claimed is: 

1. A method for evaluating the effectiveness of a stimulus, 
comprising the steps of: 

a) presenting an interactive stimulus to a respondent using 
a data processing device; 

b) as the user interacts with the stimulus, monitoring and 
recording interaction data comprising a pixel coordi- 
nate and a size of a stimulus display area; 

c) presenting to the respondent a first set of attitudinal 
questions relating to the presented stimulus; 

d) recording answers from the first set of attitudinal 55 
questions; 

e) repeating steps a)-d) for a plurality of respondents 
representative of a target group of people to which the 
stimulus is directed; and 

f) determining a stimulus effectiveness measure based at 60 
least in part on the recorded answers and the interaction 
data. 

2. The method of claim 1, wherein step b) comprises 
recording interaction data in predetermined intervals of 
time. 65 

3. The method of claim 1, wherein, in step a), the 
interactive stimulus comprises a web page. 



4. The method of claim 3, wherein, in step a), the 
interactive stimulus comprises a web site. 

5. The method of claim 4, wherein, in step b), the 
interaction data comprises clickstream information. 

6. The method of claim 1, further comprising the steps of: 

g) asking the respondent a second, delayed set of attitu- 
dinal questions, wherein the delay is at least one hour; 
and 

h) recording answers to the delayed second set of attitu- 
dinal questions, 

wherein the effectiveness measure is further based at least 
in part on the recorded answers to the delayed second 
set of attitudinal questions. 

7. The method of claim 1, further comprising the steps of: 

g) personally interviewing the respondent; and 

h) recording answers to questions asked during the per- 
sonal interview, 

wherein the effectiveness measure is further based at least 
in part on the recorded answers from the personal 
interview. 

8. The method of claim 7, wherein, in step g), the 
interview is conducted via telephone. 

9. The method of claim 1, wherein step f) comprises 
statistically analyzing the answers recorded in step d) in 
combination with the interaction data recorded during step 

b). 

10. The method of claim 1, wherein, in step f), the 
effectiveness measure comprises a score indicative of the 
stimulus' effectiveness. 

11. A computer readable medium storing computer read- 
able instructions that, when executed by one or more 
processors, cause one or more data processing devices to 
perform a method for evaluating the effectiveness of a 
stimulus, comprising the steps of: 

a) presenting an interactive stimulus to a respondent using 
a data processing device; 

b) as the user interacts with the stimulus, monitoring and 
recording interaction data comprising a pixel coordi- 
nate and a size of a stimulus display area; 

c) presenting to the respondent a first set of attitudinal 
questions relating to the presented stimulus; 

d) recording answers from the first set of attitudinal 
questions; 

e) repeating steps a)-d) for a plurality of respondents 
representative of a target group of people to which the 
stimulus is directed; and 

f) determining a stimulus effectiveness measure based at 
least in part on the recorded answers and the interaction 
data. 

12. The computer readable medium of claim 11, wherein 
step b) comprises recording interaction data in predeter- 
mined intervals of time. 

13. The computer readable medium of claim 11, wherein, 
in step a), the interactive stimulus comprises a web page. 

14. The computer readable medium of claim 13, wherein, 
in step a), the interactive stimulus comprises a web site. 

15. The computer readable medium of claim 14, wherein, 
in step b), the data comprises clickstream information. 

16. The computer readable medium of claim 11, wherein 
the computer readable instruction further comprise the steps 
of: 

g) asking each respondent a second, delayed set of atti- 
tudinal questions, wherein the delay is at least one hour; 
and 

h) recording answers to the delayed second set of attitu- 
dinal questions. 
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wherein the effectiveness measure is further based at least 
in part on the recorded answers to the delayed second 
set of attitudinal questions. 

17. The computer readable medium of claim 11, wherein 
step f) comprises statistically analyzing the answers 5 
recorded in step d) in combination with the interaction data 
recorded during step b). 

18. The computer readable medium of claim 11, wherein, 
in step f), the effectiveness measure comprises a score 
indicative of the stimulus' effectiveness. lO 

19. A data processing system for evaluating the effective- 
ness of a stimulus, comprising: 

a processor, and 

memory for storing computer readable instructions that, 
when executed by the processor, cause the data pro- 
cessing system to perform a method for evaluating the 
effectiveness of a stimulus, comprising the steps of: 

a) presenting an interactive stimulus to a respondent 
using a data processing device display; 

b) as the user interacts with the stimulus, monitoring 
and recording interaction data comprising a pixel 
coordinate and a size of a stimulus display area; 

c) presenting to the respondent a first set of attitudinal 
questions relating to the presented stimulus; 

d) recording answers from the first set of attitudinal 
questions; 

e) repeating steps a)-d) for a plurality of respondents 
representative of a target group of people to which 
the stimulus is directed; and 

f) determining a stimulus effectiveness measure based at 
least in part on the recorded answers and the interaction 
data. 



30 



20, The data processing system of claim 19, wherein step 
b) comprises recording interaction data in predetermined 
intervals of time. 

21. The data processing system of claim 19, wherein, in 
step a), the interactive stimulus comprises a web page. 

22. 11ie data processing system of claim 21, wherein, in 
step a), the interactive stimulus comprises a web site, 

23. The data processing system of claim 22, wherein, in 
step b), the data comprises clickstream information. 

24. The data processing system of claim 19, wherein the 
computer readable instruction further comprise the steps of: 

g) asking each respondent a second, delayed set of atti- 
tudinal questions, wherein the delay is at least one hour; 
and 

h) recording answers to the delayed second set of attitu- 
dinal questions, 

wherein the effectiveness measure is further based at least 
in part on the recorded answers to the delayed second 
set of attitudinal questions. 

25. The data processing system of claim 19, wherein step 
f) comprises statistically analyzing the answers recorded in 
step d) in combination with the interaction data recorded 
during step b). 

26. The data processing system of claim 19, wherein, in 
step f), the effectiveness measure comprises a score indica- 
tive of the stimulus' effectiveness. 
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